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Abstract 


Nomenclature 


A  full-envelope,  hybrid  bank-to-turn  (BTT) / 
skid-to-turn  (STT)  autopilot  design  for  an 
air-breathing  air-to-air  missile  is  carried  out 
using  the  state-dependent  Riccati  equation 
(SDRE)  technique  of  nonlinear  control. 
Hybrid  BTT/STT  autopilot  command  logic 
is  used  to  convert  the  guidance  law’s  com¬ 
manded  acceleration  to  angle  of  attack, 
side-slip,  and  bank  angle  reference  com¬ 
mands  for  the  autopilot.  In  the  midcourse 
and  terminal  phases  of  flight,  BTT  control 
is  employed  to  prevent  engine  flameout. 
In  the  endgame,  STT  control  is  employed 
to  increase  response  time.  As  the  missile 
approaches  the  endgame  phase  and  passes  a 
preset  time- to- go  threshold,  STT  commands 
are  ramped  into  the  BTT  commands  over 
a  preselected  time  interval  to  attenuate 
transient  responses.  During  this  interval,  the 
missile  is  flying  hybrid  BTT/STT. 

An  SDRE  nonlinear  outer-loop  controller 
converts  the  angle-of-attack,  sideslip,  and 
bank  angle  commands  to  body  rates  com¬ 
mands  for  the  inner  loop.  An  inner-loop 
SDRE  nonlinear  controller  converts  the  body 
rate  commands  to  fin  commands.  Hard 
bounds  on  the  fin  deflections  are  embedded 
within  the  inner-loop  controller  dynamics 
ensuring  that  the  autopilot  only  commands 
deflections  that  are  achievable.  The  non¬ 
linear  design  is  evaluated  using  a  detailed 
six-degrees-of- freedom  simulation. 
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1.  Introduction 

In  order  to  achieve  adequate  performance  over 
the  entire  envelope  of  operating  conditions,  the 
autopilot  of  a  modern  air-to-air  tactical  missile  must 
be  nonlinear.  The  nonlinearity  arises  either  through 
the  gain-scheduling  of  linear  point  designs  [1,  2,  3,  4] 
or  through  the  direct  application  of  a  nonlinear 
control  technique  to  the  problem.  Nonlinear  control 
methods  which  have  been  used  for  missile  autopilot 
design  include  recursive  backstepping  [5],  dynamic 
inversion  [6,  7],  sliding  mode  control  [8],  neural 
networks  [9],  linear  parameter  varying  (LPV)  con¬ 
trol  [10,  11],  and  state-dependent  Riccati  equation 
(SDRE)  techniques  [12,  13,  14].  In  [12],  the  SDRE 
Hi  method  was  used  to  design  a  full-envelope  pitch 
autopilot.  The  SDRE  Hi  design  has  the  same  struc¬ 
ture  as  a  linear  Hi  design  with  all  of  the  coefficient 
matrices  being  state-dependent.  In  [13,  14],  the 
SDRE  method  of  nonlinear  regulation  and  the  dif¬ 
ferential  SDRE  method  were  used,  respectively,  to 
develop  integrated  guidance/autopilot  designs.  The 
differential  SDRE  method  has  the  same  structure 
as  the  time-varying  finite-horizon  linear  quadratic 
regulator  (LQR)  with  all  of  the  coefficient  matrices 
being  state-dependent  and  requires  the  solution  of 
a  state-dependent  differential  Riccati  equation. 

In  this  paper,  we  use  the  algebraic  SDRE  method  of 
nonlinear  regulation  to  design  a  hybrid  bank-to-turn 
(BTT)/  skid-to-turn  (STT)  autopilot  for  the  control 
of  an  air-breathing  air-to-air  missile.  BTT  is  used 
in  the  midcourse  and  terminal  phases  to  prevent 
engine  flameout.  STT  is  used  in  the  endgame  to 
increase  response  time.  To  attenuate  transient 
responses,  the  STT  command  logic  is  ramped  into 
the  BTT  command  logic  as  the  missile  transitions 
from  the  terminal  phase  to  the  endgame. 


in  [15]  are  given  below  in  terms  of  the  missile’s  speed, 
angle  of  attack,  sideslip,  bank  angle,  roll  rate,  pitch 
rate,  and  yaw  rate: 
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The  system  dynamics  are  presented  in  the  next 
section.  An  overview  of  the  SDRE  technique  with 
integral  servomechanism  action  is  given  in  Section 
3.  The  SDRE  outer-loop  and  inner- loop  designs  are 
carried  out  in  Section  4.  The  BBT /STT  command 
logic  is  described  in  Section  5.  Design  results  evalu¬ 
ated  in  a  detailed  six-degrees-of-freedom  simulation 
are  presented  in  Section  6.  The  paper  is  then  closed 
with  a  Summary  section. 

2.  System  Dynamics 
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The  system  dynamics  for  a  generic  air-to-air  missile 
with  the  aerodynamic  model  and  database  generated 
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+Cn5q  cos  a)Sq  -  ( CiSr  sin  a  4-  Cn5r  cos  a)<?r] 


(7) 


3.  The  SDRE  Method 


Consider  the  autonomous,  infinite-horizon,  non¬ 
linear  regulator  problem  for  minimizing  the 
performance  index 


J  —  i  [  xtQ(x)x  4-  utR(x)u  dt  (8) 
2  Jo 

with  respect  to  the  state  x  and  control  u  subject  to 
the  nonlinear  differential  constraints: 

x  =  /(x)  +  B(£)u  (9) 

where  Q(x)  >  0  and  R(x)  >  0  for  all  x  and  /( 0)  =  0. 

The  SDRE  approach  for  obtaining  a  subopti- 
mal,  locally  asymptotically  stabilizing  solution  of 
problem  (8)-(9)  is: 

i)  Use  direct  parameterization  to  bring  the 
nonlinear  dynamics  to  the  state- dependent 
coefficient  (SDC)  form 

x  —  A(x)x  +  B(x)u  (10) 

where 

f(x)  =  A(x)x  (11) 

In  the  multivariable  case,  it  is  well-known  [16]  that 
if  /(x)  is  a  continuously  differentiable  function  of 
x,  there  is  an  infinite  number  of  ways  to  factor 
f(x)  into  A{x)x .  In  order  to  obtain  a  valid  solution 
of  the  SDRE,  the  pair  {A(x),B(x)}  has  to  be 
pointwise  stabilizable  in  the  linear  sense  for  all  x  in 
the  domain  of  interest. 


ii)  Solve  the  state-dependent  Riccati  equation 

AtP  +  PA  —  PBR~1BtP  +  Q  =  0  (12) 

to  obtain  P(x)  >  0. 


Hi)  Construct  the  nonlinear  feedback  controller 
equation : 

u  =  -R(x)~1B{x)TP(x)x.  (13) 


In  order  to  perform  command  following,  the  SDRE 
controller  can  be  implemented  as  an  integral  servo¬ 
mechanism  as  demonstrated  in  [17].  This  is  accom¬ 
plished  as  follows.  First,  the  state  x  is  decomposed 
as  _ 


Xt 

XN 


(14) 


where  it  is  desired  for  the  vector  components  of  xt 
to  track  a  reference  command  rc.  The  state  vector 
x  is  then  augmented  with  xj,  the  integral  states  of 


xt • 


(15) 


The  augmented  system  is  given  by 


x  =  A(x)x  +  B(x)u  (16) 


where 


A(x)  = 


0  I 

A(x )  0 


(17) 


and  the  SDRE  integral  servo  controller  is  given  by 


u  =  -R{x)  1B(x)tP(x) 


xi  -Jrcdt 

xt  -  rc 


Xn 


(18) 


In  order  for  the  SDRE  to  have  a  solution,  the  point- 
wise  detectability  condition  must  be  satisfied.  This 
is  accomplished  by  penalizing  the  integral  states 
with  the  corresponding  non-zero  diagonal  elements 
of  Q(x ). 


4.  SDRE  Control  Design 


The  autopilot  has  the  two-loop  structure  shown  in 
Figure  1.  Guidance  law  acceleration  commands  are 
converted  into  angle-of-attack,  sideslip,  and  bank- 
angle  commands,  oc,/3c,/ic,  using  the  BTT/STT 
Logic  presented  in  Section  5.  The  outer  loop  con¬ 
verts  ac,/3c,/L4c  to  roll-rate,  pitch-rate,  and  yaw-rate 
commands,  for  the  inner  loop.  The  inner 

loop  then  converts  pc,  gc,  rc  to  fin  commands  for  the 
actuators. 


Figure  1:  Autopilot  Two-Loop  Structure 
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SDRE  Outer-Loop  Integral  Servomechanism 


We  have 


For  the  outer  loop,,  the  state  space  is  given 

by 


x  =  [V  ai  a  0i  0  Hi  h  ]T 

u=[p  q  r]T  (19) 

The  current  values  of  the  fins  5p,5q}Sr  are  used 
in  this  loop  which  is  based  on  Eqs.  ^l)-(4).  The 
state-dependent  factorization  {A(x)>  B(x)}  for  the 
outer  loop  controller  is  given  in  the  Appendix. 
Since  thrust  is  not  controllable,  the  controllability 
of  the  speed  equation  is  duetto  a  and  (3.  Speed 
controllability  is  lost  when  a  and  /?  are  both  zero 
and  ill-conditioning  occurs  in  the  Riccati  equation 
when  a  and  (3  are  small.  A  stablizing  term  of  —  10V* 
was  added  to  the  speed  equation  in  the  controller 
to  eliminate  the  ill-conditioning. 

SDRE  Inner-Loop  Servomechanism 

For  the  inner  loop,  a  hard  bound  of  30  degrees  was 
imposed  on  the  controls  (the  fin  commands)  and  an 
SDRE  servo  was  used  instead  of  an  integral  servo. 
The  hard  bound  is  achieved  by  replacing  5p,Sq,5r 
in  Eqs.  (5)- (7)  with  saturation  sine  functions  and 
using  integral  control.  The  saturation  sine  function 
(satsin)  is  defined  as 

{m*sin(z)  for  \z\  <  f , 

m  for  z  >  j ,  (20) 

—m  for  z  <  — f 

and  is  plotted  in  Figure  2  for  m  =  1. 


m=  1 


Figure  2:  Saturation  Sine  Function 


Sp 

satsin(30,  Sp) 

Sq 

= 

satsin(30,  Sq) 

Sr 

satsin(30,<Sr) 

(21) 


with  the  fin  coefficients  expressed  in  units  of  per  de¬ 
gree  and 


Sp 

=  ~^p(sp  - 

Up) 

(22) 

Sq 

=  —X q(Sq  — 

uq) 

(23) 

Sr 

II 

1 

> 

1 

Ur) 

(24) 

being  design 

parameters 

and 

with  Ap,  A  g, . 
up,uq,Ur  being  the  new  controls.  Note  that  in 
Eqs.  (5)-(7),  the  terms  qSd(CiQ  cos  a— sina)//x, 
qS dCnxQ  fly ,  and  qSd(Q0  sin  a  -f  cosa)/Iz  are 
bias  terms,  i.e.,  state-independent  terms.  Normally, 
bias  terms  can  be  handled  within  the  SDRE  frame¬ 
work  by  multiplying  and  dividing  these  terms  by  a 
state  that  will  never  go  to  zero.  Since  p,  g,  r  and 
Sp ,  Sq:  5r  can  all  go  to  zero,  an  additional  state  s  with 
stable  dynamics  was  added  to  the  control  equations 
for  the  purpose  of  absorbing  the  biases: 


s  =  —A  8s 


(25) 


At  each  pass  through  the  inner  loop,  s  is  set  to  its  ini¬ 
tial  value.  Thus,  for  the  inner  loop,  the  state  space 
is  given  by 


x  = 


p  q  r 


_  _  _  1 T 

Sp  Sq  Sr 


U  =  [  Up  uq  ur  ]r  (26) 

with  the  fin  commands  being  computed  from 
Eq.  (21).  The  state-dependent  factorization 
{A(x),  B(x)}  for  the  inner  loop  controller  is 
given  in  the  Appendix. 


Measurement  and  Estimation  of  the  States 

If  measurements  of  a  and  (3  axe  not  available, 
there  are  at  least  two  means  of  producing  estimates 
of  these  variables.  One  is  to  use  a  nonlinear  observer 
that  is  based  on  Eqs.  (2)  and  (3)  augmented  with 
the  forcing  terms  Ka[az  -  qSCz(a>M)/M]  and 
K(s[ay  —  qSCy(j3,M)/M],  respectively,  where  Ka 
and  K@  axe  the  observer  gains.  The  observer  adjusts 
the  estimates  of  a  and  (3  based  on  the  difference 
between  the  measured  and  predicted  body  accelera¬ 
tions.  A  second  way  is  design  a  filter  based  on  Eqs. 
(2),  (3),  (5),  and  (7)  whose  measurements  are  the 
body  rates  p,  g,  and  r.  With  a  and  (3  estimated, 
the  bank  angle  p  can  be  computed  as 
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In  the  STT  mode, 


/x  —  tan' 


_!  f  sin  9  cos  a  sin  0  —  cos  6(coa  </>  sin  a  sin  0  —  sin  <f>  cos  0)\ 


-1 


cos  <f>  cos  0  cos  a  4-  sin  ^  sin  a 


The  body  accelerations  and  the  body  rates  can  be 
measured  from  the  strapdown  inertial  measurement 
unit  (IMU). 


5.  Bank-to-Tum/Skid-to-Turn  Command 
Logic 


BTT  control  is  used  in  the  midcourse  and  terminal 
phases  of  flight  to  prevent  the  air-breathing  engine 
from  flaming  out.  The  BTT  mode  is  broken  into 
three  commanded-acceleration  magnitude  regions  in 
the  inertial-frame  (I)  as  defined  below: 


If  a[  <  .lg  then  STT  Control 
Me  =  M 

If  -lg  <  a[  <  lg  then  Reduced  BTT  Control 

“(if)-' 

If  >  lg  then  Full  BTT  Control 
nc  =  tan-1 


Me 


=  m  +  tan 
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In  full  BTT  mode, 

_  (^M/qSy-jjCz-Cz^ 

I  CzJ 

Pc  =  0 

where  ac  =  [aVc  aZc]T  is  the  commanded  accelera¬ 
tion  in  the  body  frame. 

In  reduced  BTT  mode, 

<Xe  - 

(IKI  mS^Cr-W) 

Cy0 


where 


(qZcM/qS)-(Cz-CZaa) 

CZa 

=  (aycM/qS)-(Cy-CY0/3) 

Pc  cY(3 

Me  =  M 

As  the  missile  approaches  the  endgame  phase  and 
passes  a  preset  time-to-go  threshold,  STT  com¬ 
mands  are  ramped  into  the  BTT  commands  over 
a  preselected  time  interval  to  attenuate  transient  re¬ 
sponses,  i.e., 


<*c 

Pc 

=  p 

"  <*c  " 

Pc 

+ 

(1-P) 

’  <*c  ' 
/?c 

.  Vc  . 

STT 

where  p  is  a  parameter  that  varies  linearly  from  zero 
to  one  over  the  specified  time  interval. 


6.  Simulation  Results 


An  investigation  of  the  performance  of  the  autopi¬ 
lot  has  been  conducted  using  a  detailed  six-degrees- 
of-freedom  simulation.  The  simulation  imposes  rate 
limits  of  500°/sec  on  p  and  200°/sec  on  q  and  r.  The 
fin  deflection  limit  is  30°  and  the  actuator  dynam¬ 
ics  have  a  time  constant  of  .01.  In  order  to  main¬ 
tain  good  autopilot  response  over  the  flight  envelope, 
the  state  weighting  on  a/,  a,  /3j,  (3  was  varied  at  low, 
medium  and  high  altitudes  until  similar  performance 
was  achieved.  The  state  weights  were  then  curve  fit 
to  a  quadratic  function  of  dynamic  pressure,  g,  which 
in  turn  is  a  function  of  missile  velocity,  one  of  the 
states  in  the  outer-loop  ( OL ).  The  following  state 
and  control  weighting  matrices  were  selected  for  the 
outer-loop  controller: 


Q(x)ol  — 


0 

0 

0 

0 

0 

0 

0 


0 

922(®) 

0 

0 

0 

0 

0 


0 

0 

933(5) 

0 

0 

0 

0 


R(x)ol  = 


0  0  0 

0  0  0 

0  0  0 

944(5)  0  0 

0  955(5)  0 

0  0  9ee(5) 

0  0  0 

0  0  ' 

1  0 
0  1 


0 

0 

0 

0 

0 

0 

100 


Pfuii  =  tan  1 

Note  that  STT  is  used  for  small  acceleration  com¬ 
mands  to  prevent  the  missile  from  performing  180° 
rolls  to  achieve  insignificant  accelerations.  STT  con¬ 
trol  is  also  used  in  the  endgame  for  quicker  response. 


where 

922(5)  =  9.7285  *  lO"11^)2  +  1.6818  *  10 -*q(x)  +  .5114 
933(5)  =  9.5209  *  10_109(x)2  -  1.7642  *  10 ~4q(x)  +  88.1654 

<744(5)  =  922(5) 

955(5)  =  g33(5) 

966(5)  =  min{100,  [(j*  —  /ic)  180/7r]2  -f  .001} 
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By  using  a  state-dependent  weighting  on  the  inte¬ 
gral  of  fa  we  were  able  to  enhance  the  rise  time  and 
reduce  the  overshoot  of  the  fi  response.  At  the  same 
time,  the  state  weighting  on  q  and  r  was  also  varied 
at  low,  medium  and  high  altitudes  to  aid  in  achieving 
the  desired  performance.  Similarly,  the  state  weights 
were  curve  fit  to  a  quadratic  function  of  dynamic 
pressure,  q ,  which  is  a  parameter  that  is  provided  to 
the  inner- loop  ( IL )  controller.  The  inner-loop  state 
and  control  weightings  were  chosen  to  be: 

“  20  0  0  0  0  0  0  “ 

0  922  0  0  0  0  0 

0  0  <733  0  0  0  0 

Q(x)/l=  0  0  0  0  0  0  0 

0  0  0  0  0  0  0 

0  0  0  0  0  0  0 

0  0  0  0  0  0  0  _ 

■  .01  0  o' 

R(x)1L  -  0  .01  0 

0  0  .01  ^ 

where 

922  =  1-7187  *  lO^V  -  1.9783  *  10_49 +  57.3033 
933  =  1.6329  *  10~1O92  -  1.9498  *  10"4g+  117.1089 

The  inverse  time  constants  used  were 

Xp  Xq  =  Xr  — ■  Xg  -  1. 

The  autopilot  was  evaluated  at  three  different 
flight  conditions,  the  first  being  the  initial  design 
condition  of  M  =  2.7,  h  =  20000  ft .  The  second 
and  third  flight  conditions  were  at  the  missiles 
minimum  altitude  M  =  2.7,  h  =  100  ft  and  at  a 
high  altitude  M  =  2.7,  h  =  40000  ft ,  respectively. 
A  commanded  inertial  acceleration  of  aVc  =  10#, 
aZc  =  — 10<7  was  rotated  into  the  body  frame  and 
used  as  input  into  the  BTT/STT  command  logic 
and  the  vehicle  responded  in  the  BTT  mode.  Fig¬ 
ures  3-10  illustrate  the  performance  of  the  autopilot 
at  flight  condition  one  and  Figures  11-18  illustrate 
the  performance  of  the  autopilot  at  all  three  flight 
conditions  (0.1  Kft  -  Dark,  20  Kft  -  Medium,  40 
Kft  -  Light).  Figures  3-5  and  11-13  show  the 
outer-loop  tracking  of  ac,/3c,/ixc  and  Figures  6-8 
and  14-16  show  the  inner-loop  tracking  of  pc,qc,rc- 
Figures  9  and  17  show  the  fin  deflections  for  the 
two  cases.  Figures  10  and  18  show  the  autopilot 
tracking  of  the  acceleration  commands  coming  from 
the  guidance  law.  As  can  be  seen,  both  the  inner 
and  outer  loop  controllers  are  well-behaved  and 
provide  excellent  tracking  and  response  over  a  large 
region  of  the  operating  envelope.  Further  analysis 
of  the  operating  envelope  may  result  in  additional 
scheduling  of  the  weights  in  the  inner  and  outer 
loop  controllers  as  a  function  of  dynamic  pressure. 


Time  (Sec.) 

Figure  3:  Commanded  and  Achieved  Angles  of  At¬ 
tack  (M  =  2.7,  h  =  20  Kft) 


Time  (Sec.) 


Figure  4:  Commanded  and  Achieved  Angles  of 
Sideslip  {M  =  2.7,  h  —  20 Kft) 


Time  (Sec.) 


Figure  5:  Commanded  and  Achieved  Bank  Angles 
(M  =  2.7,  h  =  2QK  ft) 


Time  (Sec.) 

Figure  6:  Commanded  and  Achieved  Roll  Rates 
(M  =  2.7,  ft  =  20*7*) 


Time  (Sec.) 

Figure  9:  Achieved  Fin  Deflections  {M  =  2.7,  h  = 
20 Kft) 


Figure  7:  Commanded  and  Achieved  Pitch  Rates 
(M  =  2.7,  h  =  20K  ft) 


Figure  10:  Commanded  and  Achieved  Body  Accel¬ 
erations  (M  =  2.7,  h  =  2QKft) 


Figure  8:  Commanded  and  Achieved  Yaw  Rates 
(M  =  2.7,  h  =  20  Kft) 


Figure  11:  Commanded  and  Achieved  Angles  of  At¬ 
tack  ( M  =  2.7,  h  =  0.1, 20,  AOKft) 
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Time  (Sec.) 


Figure  12:  Commanded  and  Achieved  Angles  of 
Sideslip  ( M  =  2.T,  h  =  0.1, 20,  AQKft) 


Time  (Sec.) 


Figure  13:  Commanded  and  Achieved  Bank  Angles 
(M  =  2.7,  h  =  0.1, 20, 4QK  ft) 


Time  (Sec.) 


Figure  14:  Commanded  and  Achieved  Roll  Rates 
(M  =  2.7,  h  =  0.1, 20, 40 Kft) 


Time  (Sec.) 


Figure  15:  Commanded  and  Achieved  Pitch  Rates 

{M  =  2.7,  h  =  0.1, 20, 40-fir/t) 


Time  (Sec.) 


Figure  16:  Commanded  and  Achieved  Yaw  Rates 
(M  =  2.7,  h  =  0.1, 20, 40 Kft) 
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0  0.25  0.5  0.75  1 

Time  (Sec.) 

Figure  17:  Achieved  Fin  Deflections  (M  =  2.7,  h  = 
0.1,20,40 Kft) 
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Figure  18:  Commanded  and  Achieved  Body  Accel¬ 
erations  (M  =  2.7,  h  =  0.1,20,40*7*) 


7.  Summary 

The  SDRE  control  method  has  been  used  to  design 
a  hybrid  bank-to-turn/skid-to-tum  autopilot  for  a 
generic  air-breathing  air-to-air  missile.  The  autopi¬ 
lot  is  broken  into  an  outer  loop  and  an  inner  loop. 
The  outer  loop  converts  commanded  angle-of-attack, 
sideslip,  and  bank  angle  to  body  rate  commands  for 
the  inner  loop.  The  inner  loop  converts  the  body 
rate  commands  to  fin  deflection  commands.  Hard 
bounds  on  the  fin  deflections  are  embedded  within 
the  inner-loop  controller  dynamics  so  the  autopilot 
only  commands  fin  deflections  that  are  achievable. 
The  design  results  are  very  promising  and  it  is  ex¬ 
pected  that  the  autopilot  will  provide  excellent  per¬ 
formance  in  an  air-to-air  intercept  scenario.  Future 
work  will  include  flying  air-to-air  intercepts  to  exer¬ 
cise  the  BTT,  hybrid  BTT/STT,  and  STT  modes  of 
the  controller.  Additionally,  a  wind  model  will  be  in¬ 
corporated  into  the  simulation  to  validate  the  a  and 
/ 3  observers.  Finally,  the  robustness  of  the  autopilot 
wall  be  evaluated  in  the  presence  of  uncertainties  in 
the  aerodynamic  coefficients. 
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